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In general there exists no relationship between the fixed point sets of the composition and 
of the average of a family of nonexpansive operators in Hilbcrt spaces. In this paper, we 
establish an asymptotic principle connecting the cycles generated by under-relaxed composi- 
tions of nonexpansive operators to the fixed points of the average of these operators. In the 
special case when the operators are projectors onto closed convex sets, we prove a conjecture 
by De Pierro which has so far been established only for projections onto affine subspaces. 
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1 Introduction 



Fixed points of compositions and averages of nonexpansive operators arise naturally in diverse 
settings; see for instance [U El fTOj [T2] and the references therein. In general there is no simple 
relationship between the fixed point sets of such operators. In this paper we investigate the 
connection of the fixed points of the average operator with the limits of a family of under- 
relaxed compositions. More precisely, we consider the framework described in the following 
standing assumption. 

Assumption 1.1 Ti is a real Hilbert space, D is a nonempty, closed, convex subset ofTt, m ^ 2 
is an integer, I = {1, . . . ,m}, (T)j g / is a family of nonexpansive operators from D to D, and 
(FixTj)j g / is their fixed point sets. Moreover, we set 



1 



m 



£ r < 



R = T m o • • • o T\ 
k (Vee]0,l[) R £ = 



(1.1) 



'ld+e(T m -Id)) 



Id+e(Ti-Id)). 



When the operators (T)j G / have common fixed points, FixT = Dili FixT ^ [5j Proposi- 
tion 4.32]. If, in addition, they are strictly nonexpansive in the sense that 



(Vi G I)(\/x eO\ FixTi)(Vy G Fix!;) \\T iX - y\\ < \\x - y\ 



(1.2) 



it also holds that Fixi? = f] ieI FixTj [5j Corollary 4.36], and therefore FixR = FixT. However, 
in the general case when f] i€l FixTj = 0, the question has been long standing and remains open 
even for convex projection operators, e.g., |10t Section 8.3.2] and [2]. Even when m = 2 and T\ 
and T<i are resolvents of maximally monotone operators, there does not seem to exist a simple 
relationship between Fixi? and FixT [TB], except for convex projection operators, in which case 
FixT = (1/2) (Fix R + FixR'), with R' = T x o T 2 (see [3J H3] for related results, and [7] for the 
case of m ^ 3 resolvents). 

When (Ti)i£i = (Pj)j e / are projection operators onto nonempty closed convex sets (Q)^/, 
FixT is the set of minimizers of the average square-distance function [31 [13"1 [T5] 



$: H 



X H-> 



— Yd 2 c .(x), 



(1.3) 



iei 



while FixR is related to the set of Nash equilibria of a cyclic projection game. Indeed, the fixed 
point equation x = Rx can be restated as a system of equations in (xi, . . . , x m ) G H m , namely 



Xl 


— r\X m 


X 2 


= T 2 xi 


•Em 


— Mn^m-li 



(1.4) 



which characterize the Nash equilibria of a game in which each player i G / selects a strategy 
Xi G Ci to minimize the payoff x i— > ||x — Xj_i||, with the convention xq = x m . It is worth 



noting that, for m Js 3, these Nash equilibria cannot be characterized as minimizers of any 
function vl/ : T-L m — > R over C\ X • • • X C m [2], which further reinforces the lack of hope for simple 
connections between FixP and FixT. It was shown in [16] that, if one of the sets is bounded, 
for every yo £ Ti, the sequence (ykm+i, ■ ■ ■ ,Ukm+m)k<=N generated by the periodic best-response 
dynamics 

Vkm+l = P\Vkm 
Vkm+2 = PlVkm+l 

(1-5) 



(Vfc € N) 



converges weakly to a solution (xi, . 



Ukm+m 
> 3Jm) tO 



- ^mUkm+m—lj 

(see Fig. [TJ. Working in a similar direction, 
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Figure 1: Cycles in the method of periodic projections. 



and motivated by the work of [TTj on under-relaxed projection methods for solving inconsistent 
systems of affine inequalities, De Pierro considered in p3] an under-relaxed version of (jl.5p . 
namely 

Vlm+i =(ld+e(Pi-Id))y| m 



(Vfc e N) 



ykm+2 



(ld+e(P 2 -Id))y| 



m+l 



(1.6) 



ylm+ m = ( Id +e(P m - Id))yfc m+m _!- 

Under mild conditions the resulting sequence (y| m+ i,Z/f m+2 > • • • > Ukm+m) ken converges weakly 
to a limit cycle that satisfies the coupled equations 



(V£G]0,1[ 



x\ 



■ I ■■) 



Id+e(P 1 -Id))x^ 
ld+e(P 2 -Id))xf 



Id+£(P m -Id))x^_ 1 . 



(1.7) 



In [TU Conjecture I], De Pierro conjectured that as e — >■ these limit cycles (xf, . . . ,x^ l ) £e i 0) i[ 
shrink towards a single point which is a minimizer of $, i.e., a fixed point of T. In contrast with 
(jl.4p . the solutions of which do not satisfy any optimality criteria, this conjecture suggests an 



asymptotic variational principle for the cycles obtained as limits of the under-relaxed version of 
(jl.5p . An important contribution was made in [6], where it was shown that De Pierro's conjecture 
is true for families of closed affine subspaces which satisfy a certain regularity condition. 

In this paper we investigate the asymptotic behavior of the under-relaxed cycles 






(ld+£(Ti 

(ld+e(T 2 



ld))x 
Id))x 



Id+e(T m -Id)): 



'TO— 1 



(I- 



as e — > in the general setting of Assumption 11.11 In Section [2] we present a first general 
convergence result, which establishes conditions under which the limits as e — > of the m curves 
(xf) eG ] .i[ (i £ I) exist and all coincide with a fixed point of T. This result not only gives 
conditions under which De Pierro's conjecture is true, but also extends its scope from projection 
operators to arbitrary nonexpansive operators. In Section we revisit the problem from a 
constructive angle. Given an initial point yo £ D and e £ ]0, 1[, it is known Theorem 5.22] 
that the cycles in (|1.8|) can be constructed iteratively as the weak limit of the periodic process 



(Vfc £ N) 



Vtm+i ={ld+e(Ti-Id))y% r , 



Vkm+2 



Id+e(T 2 -U))y £ km+1 



(1.9) 



y% 



m+m 



Id+e(T m -Id))y| 



m+m—l' 



We analyze the connection between this iterative process and the trajectories of the evolution 
equation 

jx'(t) + x(t) = Tx(t) on ]0, +oo[ 

1 x(0) = y , 



(1.10) 



and then establish extended versions of De Pierro's conjecture under various assumptions. 

Notation. The scalar product of H is denoted by (• | •) and the associated norm by || • ||. 
The symbols — *■ and — > denote, respectively, weak and strong convergence, and Id denotes the 
identity operator. The closed ball of center x € % and radius p £ ]0, +oo[ is denoted by B(x; p). 
Given a nonempty closed convex subset C C H, the distance function to C and the projection 
operator onto C are respectively denoted by dc and Pc- 



2 Convergence of general families of under-relaxed cycles 



We investigate the asymptotic behavior of the cycles (xf )j g / defined by (|1.8|) when e — >• 0. Let 
us remark that such a cycle (xf )jg/ is in bijection with the fixed points of the composition R £ 
of (fTTj) . Indeed, z £ = 



is a fixed point of R £ ; conversely, each z £ £ Fixi? e generates a cycle 



by setting, for every i £ /, x\ 
standing assumption. 



(Id +e(Ti — Id))x £ _ 1 , where Xq = z £ . This motivates our second 



Assumption 2.1 For every e € ]0, 1[, R e is given by (jl.ip and 

(3r ? G]0,l])(3 / 3e]0,+oo[)(VeG]0,r ? [)(3z £ GFi Xj R e ) \\z £ \\ < /3. (2.1) 



For later reference, we record the fact that under this assumption the cycles in (|1.8p can be 
obtained as weak limits of the iterative process (|1.9|) . 

Proposition 2.2 Suppose that Assumptions !! . 1\ and \2. 1\ are satisfied. Letyo £ D and e € ]0, rj[. 
Then the sequence (y| m+1 , . . . ,yf. m+m )keN produced by (|1.9p converges weakly to an m-tuple 
(xf, . . . ,x £ m ) which satisfies (|1.8p . 

Proof. This follows from [SJ Theorem 5.22]. D 

The following result provides sufficient conditions for Assumption 12.11 to hold. 
Proposition 2.3 Suppose that Assumption \l.l\ holds, together with one of the following. 

(i) For some j € /, Tj has bounded range. 
(ii) D is bounded. 

Then Assumption \2. 1\ is satisfied. 



Proof. It is clear that (ii) is a special case of (i) Suppose that (i) holds. Fix e G ]0, 1] and 



y € D, and take p € [max ie / x .{j} \\Tiy — y\\, +oo [ such that Tj(D) C B(y; p). Furthermore, let 
x E D, set xq = x, and define recursively X{ = (1 — e)x^i + eTiXi-i, so that x m = R £ x. Then 

(Vi G J\ {j}) \\xi — 2/|| = ||(1 -e)(zi_i -y) +e(TiX i _ 1 -y)|| 

< (1 - e)||xj_i - y\\ + s\\TiXi-i - T t y\\ + e\\Tiy - y\\ 

< ||xv-i - y\\ + sp (2.2) 

and 

\\ x j — 2/11 < (1 -e)||»j-i — 2/11 +e||r i x i _i — 2/|| 

<(l- £ )||^_i-y||+ep. (2.3) 

By applying inductively (|2.2p and (|2.3p to majorize ||ar m — y\\, we obtain 

||i? £ x - y\\ = \\x m - y\\ < (1 - e)||x - y|| + em/). (2.4) 

This implies that R e maps Df]B(y; mp) to itself. Hence, the Browder-Gohde-Kirk theorem (see 
Theorem 4.19]) asserts that R e has a fixed point in B(y; mp). Moreover, if x is a fixed point 
of R e , (|2.4p gives ||x — y\\ ^ mp, which shows that (|2.ip holds with 77 = 1 and /3 = ||j/|| + mp. □ 

To illustrate Assumption ^. 11 it is instructive to consider the following examples. 



Example 2.4 The following variant of the example discussed in fl4"j Section 3] shows that 
is a non trivial assumption: % is the Euclidean plane, m = 3, a G R, fi G R, 7 G ]0, • 
e € ]0, 1[, and (T)i^3 are, respectively, the projection operators onto the sets 

^x{/3}, and C 3 = {(6,6)€]0,+oo[ 2 | && > 7}- 



Ci = R x {a}, 
Then we have 



C 2 



foo[, 
(2.5) 



'FixT ={(&,&) eC 3 I 6 = (a + /3)/2} 

Fixi? e = {(6,6)eC 3 |6 = ((l-e)a + /3)/(2-e)}. 

Thus, depending on the values of a and /3, we can have FixT = Fix R ^ 0, FixT = Fix R 
FixT ^ Fixi? = 0, Fixi? / FixT = 0, or / Fixi? / FixT / 0. Now set rj = 1 + 
Then, under the assumption that a + /3 < < /3, we have ?y G ]0, 1[ and Fixi? e = if e 
while Fixi? e 7^ if e > 77. On the other hand, under the assumption that /3 < < a 
?7 G ]0, 1[ and Fixi? e 7^ if e < rj, while Fixi? e = if e ?2 rj. Moreover, setting 



(2.6) 



= 0, 
0/a. 
^ V, 
+ 0, 



(VeG]0,7?[) 



ir 



27 



+ 



1 (l-e)a + /3 



1 — e)a + j3 e 

(2-e) 7 (1 



2-e 

e)a + /3 



GFixiT 



(l-e)a + /3 ' 



(2.7) 



GFixi? £ . 



we see that (y e ) £ ^\o,ri\ is an unbounded curve, while (z £ ) eG ]o ]7? [ is bounded. 



Example 2.5 In Example 12.41 the sets (FixTj)i^j^3 are nonempty, and one may ask whether 
this plays a role in the nonemptiness of Fixi?, FixT, or Fixi? e . To see that such is not the case, 
define T3 as in Example 12.41 and consider the modified operators T\ : (£1, £2) h ^ (£1 + M, a) and 
T2 : (£1,^2) ^ (£1 — M)/^)j where /i > 0. Although now the nonexpansive operators Ti and T2 
have no fixed points, the operators T, R, and i? £ remain unchanged. 

Example 2.6 By considering products of sets of the form ()2.5p one can build an example in 
which FixT is nonempty but the sets (Fix.R e ) ee ]o u are empty. More precisely, let Ti = £ 2 (N), 
and let (a n ) nG N, (/3 n )nm, and (7n)neN be sequences in £ 2 (N) such that (7n/(«n+/3n))nGN G £ 2 (N) 
and (Vn G N) /3 n < < a n + /3„ and 7„ > 0. Set 

'Cl = {(£ n ) nGN G ^ 2 (N) I (Vn G N) £ 2 n = « n } 

C 2 = {(£n)nGN G ^(N) | (Vn G N) 6n = /?n} (2-8) 

C 3 = {(£n)nGN G ^(N) | (Vn G N) £ n > and £ 2 n-l6n > 7n}- 

Then FixT / but, for e G ]0, 1[, we have Fixi? £ ^ if and only if (Vn G N) e < 1 + 
/32n+i/a2n+i- In particular if we take, for every n G N \ {0}, a n = (n+ l)/n' 2 , f3 n = — 1/n, and 
7 n = 1/n 3 , then Fix iff = for every e G ]0, 1[. 

Example 2.7 (J6J Example 4.1]) Let m = 2, and let Ti and T2 be the projection operators onto 
closed affine subspaces C\ C Ti and C2 C "H, respectively. If % is finite-dimensional, the sets 
Fixi?, (Fixi? e ) eG i 0il r, and FixT are nonempty; if Ti is infinite-dimensional, there exist C\ and 
C2 such that these sets are all empty. However, if the vector subspace [C\ — C\) + (C2 — C2) is 
closed, then FixT / and (Ve G ]0, 1[) Fixi? e / 0. 



6 



The next result establishes conditions for the convergence of the cycles of (jl.8p when the 
relaxation parameter e vanishes. 

Theorem 2.8 Suppose that Assumptions li.il and \2.1\ are satisfied. Then FixT 7^ 0. Now let 
( x m)e£]o,r)[ = ( z£ )ee]o,ri[ be the bounded curve provided by (j2.1|) and denote by (xf , . . . , aJ^JeeltW 
the associated family of cycles arising from (|1.8p . Then (xf , . . . , a^Jeelo.rrt * s bounded and each 
of its weak sequential cluster points is of the form (x, . . . , x), where x G FixT. Moreover, 

(Vi G I) lim ||xf - xf_J = 0, where (Ve € ]0, r?[) xg = ad,. (2.9) 

in addition, suppose that one of the following holds. 

(i) (Vx G FixT)(Vy G FixT) {x £ m \ x — y) converges as e — > 0. 
(ii) (Vx G FixT) ||x^ — x|| converges as e — > 0. 
(iii) FixT is a singleton. 

Then there exists x G FixT such that, for every i G I, x\ — v x as e — >■ 0. Finally, suppose that 
Id — T is demiregular on FixT, i.e., 

(V(y fc ) feeN 6 Z? N ) (Vy G FixT) J yfc ~" y => y fc -»• y. (2.10) 

[yk-Ty k ^0 

Then, for every i G /, xf — >■ x as e — )• 0. 

Proof. Fix z a D. By nonexpansiveness of the operators (T)j g /, we have 



(Vi G I) ||Tixf_! — a;f_i|| ^ ||^ixf_i - Tiz\\ + ||Tz - z|| + \\z - xf^H 

< 2||xf_ 1 -z[| + ||Tz-z||. (2.11) 



In particular, for i = 1, it follows from the boundedness of (x^) eG ] ^[ that (Tlx^ — x^) £e ] 0i ^[ is 
bounded. In turn, we deduce from (|1.8p that (xf ) ee j 0fl [ is bounded. Continuing this process, we 
obtain the boundedness of (xf , . . . , x^ 1 ) ee ] . r? [ and the fact that 

{Vtel) (TixU-xU)^^ is bounded. (2.12) 

On the other hand, adding all the equalities in (|1.8p . we get 

(VeGjO^D J>z?_! = JX (2.13) 

is/ i€l 



from which it follows that 
(Vee]0,»7[) Tx £ m 



•Lr 



— S^Tr 6 - T £ 

i=\ 
1 m 1 m 

ETiX i _ l + — y. \TiX m — TiXi_i) 
4=1 1=2 

1 m 1 m, 



■/?) 



t=l 

777 — 1 



t=2 



m *—~ ' 



1 



771—1 



X : 






m 



Eft 



+ 1^4 



r i+ ixf). 



(2.14) 



7=1 7=1 

Hence, using the nonexpansiveness of the operators (Tj)j 6 j, we obtain 

777—1 



(VeG]0,7?[) ||Tx £ m -<JK-^ 

7D ^ * 



•-/-' ., 



Consequently, since (|1.8p and (|2.12|) also imply that 



(Vie/) ||xf 



-7-11 



^ IMi-^i— 1 



a;f_ill — ^ as e — > 0, 



(2.15) 



(2.16) 



thus proving (|2.9|) . the triangle inequality gives ||x^ 
yields 

TxL - xL - 



0. 



0, which, combined with ([2.151) . 

(2.17) 



Hence, we can invoke the demiclosed principle [5} Corollary 4.18] to deduce that every weak 
sequential cluster point of the bounded curve (im) £e ]o,ij[ belongs to FixT, which is therefore 
nonempty. In view of (|2.16|) . we therefore deduce that every weak sequential cluster point of 
(xf , . . . , ^m)eG]o,77[ i s °f the form (x, . . . , x), where x G FixT. It remains to show that under any 
of the conditions (i) , (ii) , or (iii) , the curve (Xm)ee]o,i[ is weakly convergent. Clearly (iii) implies 



(i) , and the same holds for (if 



since 



(V(x,y) G H 2 )(Ve G }0, V [) (x £ n \x-y) = -(\\x e m - y\\ 2 



\X T 



n2 n n2 

x\\ + \\x\\ 



(2.18) 



Thus, it suffices to show that under (i) the curve (Xm) e e]o,7,[ nas a unique weak sequential 
cluster point. Let x and y be two weak sequential cluster points and choose sequences (e n )neN 
and (e^) nS N in ]0,rj[ converging to such that xf% — *■ x and x m " — v y as n — > +oo. As 
shown above, we have x and y lie in FixT and, therefore, it follows from (i) that (x \ x — y) = 

lim n ^ +00 (x^ 1 | x - y) = lim n ^ +00 (xm \ x - y) = (y \ x - y). This yields \\x - y\\ 2 =0 proving 
our claim. 

Finally, let us establish the strong convergence assertion. To this end, let (e n ) ng N be a 
sequence in ]0,rj[ converging to 0. Then, as just proved, x 6 ^ — *■ x G FixT as n — > +oo. On 
the other hand, (|2.17p yields x 6 ^ — Tx 6 ^ — > as n — >■ +oo. Hence, we derive from (|2.10p that 
x^ — > x as n — >■ +oo. This shows that x^ — >• x as e — > 0. In view of (|2.16p . the proof is 
complete. D 



Remark 2.9 The demiregularity condition f|2. 10J) is a specialization of a notion introduced in 
[TJ Definition 2.3] for set-valued operators (see also |19|. Definition 27.1]). It follows from [IJ 
Proposition 2.4] that ()2.10p is satisfied in each of the following cases. 

(i) Id — T is uniformly monotone at every y £ Fix T. 

(ii) Id —T is strongly monotone at every y £ Fix T. 

(iii) T = Id— V/, where / £ ro(%) is uniformly convex at every y £ FixT. 

(iv) D is boundedly compact: its intersection with every closed ball is compact. 

(v) D = % and Id — T is invertible. 

(vi) T is demicompact [T7]: for every bounded sequence (y n ) n £N in D such that (y n — Ty n ) ne ^ 
converges strongly, (y n )„ e N admits a strongly convergent subsequence. 

In the special case when (Tj)j g j is a family of projection operators onto closed convex sets, 



Theorem 12.81 asserts that De Pierro's conjecture is true under any of conditions (i) - (iii) In 
particular, we obtain weak convergence of each point in the cycle to the point in Fix T if this set 
is a singleton, which can be considered as a generic situation in many practical instances when 
Hie/ Pi x ^i 7^ 0- The following example illustrates a degenerate case in which weak convergence 
of the cycles can fail. 

Example 2.10 Suppose that in Theorem 12.81 we have (~] i€l FixTi ^ 0. Then it follows from 
the results of [5j Section 4.5] that 

(Ve€]0,l[) Fix i? £ = p| Fix ((1 - e) Id +eT;) = p| FixT; = FixT. (2.19) 

iei iei 

Now suppose y and z are two distinct points in FixT and set 

(w el o,i[) 4, = (»■ 3]' Se T ; P-20) 

[z, if |l/ej 1S °dd. 

Then (^) e e]o,i[ has two distinct weak cluster points and therefore it does not converge weakly, 
although Assumptions 11.11 and 12.11 are trivially satisfied. 



3 Convergence of limit cycles of under-relaxed iterations 



!>•••> x m)e£]0,r][ 



As illustrated in Example l2.10l in general one cannot expect every solution cycle (x\ , . . . , x 
in (|1.8p to converge as there are cases that oscillate. Theorem 12.81 provided conditions that rule 
out multiple clustering and ensure the weak convergence of the cycles as e — > 0. An alterna- 
tive approach, inspired from [14J, is to focus on solutions of (|1.8p that arise as limit cycles of 
the under-relaxed periodic iteration (jl.9p started from the same initial point yo £ D for every 
e £ ]0, rj[. This arbitrary but fixed initial point is intended to act as an anchor that avoids 
multiple cluster points of the resulting family of limit cycles {x\ , . . . , £m)eg]o,7/[- 



As mentioned in the Introduction, for convex projection operators De Pierro conjectured that, 
as e — > 0, the limit cycles shrink to a least-squares solution, namely (xf , . . . , x e m ) — *■ (x, . . . ,x), 
where x is a minimizer of the function <J> of (|1.3p . In [6l Theorem 6.4] the conjecture was proved 
for closed affine subspaces satisfying a regularity conditions, in which case the limit x exists in 
the strong topology and is in fact the point in S = Argmin $ = Fix T closest to the initial point 
yo, namely x = PsVo- However, for general convex sets the conjecture remains open. 

We revisit this question in the general framework delineated by Assumptions II. ll and 12. ll with 
a different strategy than that adopted in Section [2 Our approach consists in showing that, for 
e small, the iterates (|1.9|) follow closely the orbit of the semigroup generated by A = Id — T, i.e., 
the semigroup associated with the autonomous Cauchy problem 

ix'(t) = -Ax(t) on]0,+oo[ 

\x(0)=yo- 

This allows us to relate the limit cycles {x\ , . . . , ^m)ee]o,r;[ to the limit of x(t) when t — > +oo. Note 
that, since yo G D = domyl and A is Lipschitz, (|3.ip has a unique solution x G S 1 (]0, +oo[ ; D); 
see, e.g., [8] Theorem 1.1.4]. In addition, if there exists Xoo G H such that x{t) — x x^ as 
t — > +oo, then x 6 FixT. In the case of convex projections, (|3.ip reduces to the gradient flow 



U / (t) = -V$(x(t)) on]0,+oo[ 
\x(0) =yo, 

which converges weakly to some point Xqo G S as t — > +oo [9, Theorem 4], and one may therefore 
expect De Pierro's conjecture to hold with x = x^ under suitable assumptions. Note, however, 
that for non-affme convex sets the limit Xqo might not coincide with the projection PsVo- 



3.1 Under-relaxed cyclic iterations and semigroup flows 

In order to study (|1.9p for a fixed e G ]0, 1[, it suffices to consider the iterates modulo m, that is, 
the sequence (y| m )fc S N = {{R e ) k yo)keN, which converge weakly towards some point x e m G Fixi? e 
(see Proposition I2.2p . The key to establish a formal connection between the iteration (|1.9p and 
the semigroup associated with (|3.ip . is the following approximation lemma that relates R e to 
A = ld-T. 

Lemma 3.1 Set A = Id— T, fix z G D, and set p = maxj g / \\TiZ — z\\/2. Then 

(Vee [0,l])(Vx eD) \\R £ x -x + emAx\\^ e 2 (3 m - 2m - l)(||x - z\\ + p). (3.3) 

Proof. Since the case e = is trivial, we take e G ]0, 1]. Define operators on D by 

(Vj G /) R) = ( Id +£(Tj - Id)) o • • • o ( Id +e(Ti - Id)) (3.4) 

and 

1 1 j 

(VjG/) ^ = -( J R J e -Id) + -^(Id-r j ). (3.5) 



«=i 
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Then R £ = R^ and therefore R 6 — Id +emA = s 1 E £ n . Thus, the result boils down to showing 
that (Vx G D) \\E e m x\\ < (3 m - 2m - l)(\\x - z\\ + p). We derive from ([33]) that 

(Vj G {1, . . . , m - 1}) £j +1 = £| + i ((Id -T i+ i) - (Id -Tj- +1 ) o Rfj . (3.6) 

Now let x G D. Since the operators (Id— Tj)i^j^ m _i are 2-Lipschitz, we have 

2 
(Vj G {!,..., m-1}) \\E e j+l x\\ < ||£^a?|| + -||x-i^x|| 






\E £ jX \\+2 



^2{ld-Ti)x-eE 



3 X 



1=1 



< (1 + 2£)||£fx|| + 2^(||x - z|| + ||z - Tiz|| + ||r<« - T* 



i=l 

< (l + 2e)||.E?x||+4j(||:c-z||+p). (3.7) 

Using (|3.7p recursively, and observing that i2fx = 0, it follows that 

m— 1 

K*|| < 4(||x - z\\ + P )^2 i(l + 2 £ ) m - 1 " i . (3.8) 

i=i 

Upon applying the identity Y!?=i J aj = ((m - I) a m+1 - ma m + a) / (1 - a) 2 to a = (1 + 26)- 1 G 
]0, 1[, we see that the sum in (J3.8J) is equal to ((1 + 2e) m — 1 — 2me)/(4e 2 ), which increases 
with e attaining its maximum (3 m — 2m — l)/4 at e = 1. This combined with (|3.8|) yields the 
announced bound. D 

Remark 3.2 For firmly nonexpansive operators, such as projection operators onto closed con- 
vex sets, the operators (Id — Tj)j g / are nonexpansive and the previous proof can be modified to 
derive a tighter bound in (|3.3p . namely 

(VeG [0,l])(VcG-D) \\R £ x-x + emAx\\^e 2 {2 m -m-l){\\x-z\\+2p). (3.9) 



We proceed with the announced connection between (|1.9j) and (|3.ip . This will be used later 
to establish De Pierro's conjecture in several alternative settings. 



Proposition 3.3 Let yo G D, let x be the solution of (J3JJ), suppose that Assumptions \1.1\ 
and \2.1\ are satisfied. For every e G ]0, r/[, set (zfykzN = {(R £ ) k yo)k&n and let ip e be the linear 
interpolation of (zjQfceN given by 

(Vfc G N) (Vt G [feme, (Jfe + l)me[) ^ £ {t) =z% + — —(z £ k+1 - z%). (3.10) 

Then (Vt G ]0,+oo[) sup 0<t<f ||^ e (i) -z(i)|| -► w/ien e -> 0. 

Proof. Set A = Id— T, let e G ]0, ?7[, and fix z G D. The function ^ £ is differentiable except 
at the breakpoints {kme I k G N}. Now set (V/c G N) Jfc = ]fcme, (fc + l)me[. According to 
Lemma 13,1} we have 

(Vfc g N)(vt g J fe ) (^)'(t) = ^-(4+i - 4) = ^-(R £ 4 - 4) = -M + eh%, (3.11) 
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where \\h e k \\ ^ (3 m — 2m — l)(||z| — z\\ + p)/m. Now set 

(Vife G N)(Vi G J fe ) /i £ (t) = A^ £ (t) - -44 + eh%. (3.12) 

Then 

(Vifc G N)(Vt G J k ) {ip £ )'{t) = -A^ £ {t) + h £ (t). (3.13) 

Moreover, it follows from (|2.ip that there exists a constant a G ]0, +oo[ independent from e such 
that (V/e G N) ||M|| ^ a. Hence, since A is 2-Lipschitz, there exists 7 G ]0,+oo[ such that 

(V£;GN)(V£G J k ) \\h £ {t)\\ < 2||V> £ (i) - 4|| + e||/i||| 

<^ o|| ~£ r £ II 1 c || u£ It 

^ z ll z fc+l ~~ z k\\ + £ \\ n k\\ 

= 2em\\ - Az% + eh%\\ + e\\h%\\ 

^ ej. (3.14) 

Next, consider the function 6: [0, +oo[ — >■ [0, +oo[ defined by 9(t) = \\x(t) — ^ e (t)|| 2 . Then it 
follows from the monotonicity of A that 

(Vt G [0, +oo[ \ {kme \ k G N}) 0'(i) = 2(x(t) - V e (*) I z'(i) - W> £ )'(i)) 

= 2(x(t) - V £ (0 I A0 e (t) - /i e (i) - Ax(t)) 
^2{x(t)-ij £ (t) I -/i e (t)) 
<2||ic(t) -ip £ (t)\\\\h £ 



< 2e 7 v / ^). (3.15) 

Integrating this inequality and noting that 0(0) = 0, we obtain (Vi G [0, +oo[) ||^ £ (t) — a;(t)|| = 
^/e(fj ^ ejt. Now let t G]0,+oo[. Then sup oaa - ||^ e (t) -x(t)|| ^ £7*^0 as e -> 0. □ 

3.2 Strong convergence under stability of approximate cycles 

In this section, we investigate the strong convergence of the cycles defined in (jl.8p when a 
stability condition holds. 

Theorem 3.4 Suppose that Assumptions \l.i\ and \2.1\ are satisfied, and that 

(VzGFixT) \imd FixR e(z) = 0. (3.16) 

In addition, let y$ G I?, and suppose that the orbit of y® in the Cauchy problem (|3.1|) converges 
strongly, say x(t) ->i£D as t — >• +00. For every e G ]0, T][, let (x £ )i € i be the cycle obtained as 
the weak limit of (jl.9p in Proposition ^. SX Then x G FixT and (Vi G /) xf — > x when e — > 0. 

Proof. Since x(i) — >• x, (|3.ip implies that x'(i) converges to Ax and therefore Ax = since 
x'(t) ->• 0. Hence, x G FixT. Now fix 0" G ]0,+oo[ and i G ]0, +oo[ such that (Vi G [i, +00 [) 
||x(i) -x|| < 5. For e very e G ]0,rj[, set (4) feG N = (yf m )fceN = {{R £ ) k yo)keN and define the 
function ip £ as in ()3.10p . By Proposition 13.31 there exists £0 G ]0,n[ such that 

(VeG]0,eo[)(VtG[0,t + m]) \\^ £ (t) - x(t)\\ ^ 5. (3.17) 
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Now let e G ]0,£o[> choose fco G N such that home G [i, i + m], and set x e = PpixRax (recall 
that, since D is closed and convex and R e is nonexpansive, FixR £ is closed and convex [5j 
Corollary 4.15]). Then \\zf — x(kome)\\ = \\ip £ (kome) — x(kome)\\ ^ 5 and therefore \\zf, — x|| ^ 
25. Since R e is nonexpansive, we have (Vfc G N) ||4+i — x £ \\ ^ ||z| — x £ \\. Hence, for every 
integer k ^ ko, we have 

||4-rc e || ^ ||4 -S £ || < ||4 -x|| + ||x-x e || ^25 + d FixR .(x) (3.18) 

and therefore 

\\yl m -x\\ = \\4-x\\ ^25 + 2d Fix R^x). (3.19) 

Since Proposition 12.21 asserts that y e km — *■ x^, we get 

Ikm-^IK 11™ l|y|m _ ^ll ^25 + 2d FiXjR e(x), (3.20) 

fc— >+oo 

and (|3.16p yields 

Em lb* -xll ^25. (3.21) 

Letting 5 — >• 0, we deduce that x^ — >• x as e — >• 0. In turn, it follows from (|2.9p that (Vi G J) 
xf — )• x as e — ► 0. D 

The following corollary settles entirely De Pierro's conjecture in the case of m = 2 closed 
convex sets in Euclidean spaces. 

Corollary 3.5 In Assumption \1. 11 suppose that % is finite- dimensional, D = H, and m = 2, 
and let T\ = P\ and T 2 = P2 be the projection operators onto nonempty closed convex sets such 
that 

FixT = S = Argmin $ / 0, where $ = - (d 2 Cl + d 2 C2 ) . (3.22) 

Let yo (zTi and letxdS be the limit of the the solution x of Cauchy problem 



(3.23) 



(VfcG 



(3.24) 



J x'(t) + x(t) = \ (Pix(t) + P 2 x(t)) on ]0, +oo[ 
\x(p) = yo- 

For for every £ G ]0, 1[, let xf = lim^ +00 yffc+i an d x \ = nm fc^+oo y 2 k+2> where 

vk + i =(id+£(p l -id)) y £ k 

yk+2 =(ld+e(P 2 -Id))y| fe+1 . 
Then xf — > x and x| — > x w/ien e — > 0. 

Proof. Fix z G S, and set a = P x z and 6 = P 2 z. Then z = (a + b)/2 and (Ve G ]0, 1[) 
z ^ = ((l _ e )a + 6)/(2 - e) G FixP e . Thus 

dFixfl'(z) < \\z - z £ \\ = ^ _ ° ->■ as e^0, (3.25) 

and the conclusion follows from Theorem 13.41 D 

We conclude this section by showing that, in contrast with (|3.25p . the condition (|3.16p can 
fail in the case of projection operators in the presence of m = 3 sets. 
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Figure 2: An example in which the condition (|3.16j) fails. 

Example 3.6 Suppose that % = M 3 and m = 3, and let Ti, T 2 , and T3 be, respectively, the 
projection operators onto the bounded closed convex sets (see Fig. [2]) 

d = [-1, 1] x {-1} x {1} 

C 2 = [-1, 1] x {1} x {1} (3.26) 

[C 3 = {(6, 6, £3) e E 3 I 6 e [-1, 1], & e [o, l], (l - &)(£? - 1) + £ 2 2 ^ o}. 



Then the set of least-squares solutions is S = FixT = [—1, 1] x {0} x {1} C C3. Moreover, 



(VeG]0,l[) FixR £ = {z £ } 



o, ^ +£(1 - £ j j 



ir- 



3(l-£)+e 2 ' 3(l-e) + e 2 



)}■ 



(3.27) 



where u> e is the unique real solution of 2-w 3 + u; = e/(2 — e). Clearly z 6 — >• (0, 0, 1) € 5 as e — > 0, 
but (VzG 5 \ {(0,0,1)}) d FixR .(z) >0ase^0. 



3.3 Strong convergence under local strong monotonicity 

Another situation covered by Theorem 13.41 is when the operator T has a unique fixed point x 
and A = Id — T is locally strongly monotone around x, namely 

(3 a G ]0, +oo[)(3 5 G ]0, +oo[)(Vx G D n B(x; 5)) (x-x\x- Tx) ^ a\\x - x\\ 2 . (3.28) 

In the case of convex projections operators, then A = V$ and, if <3? is twice differentiable at x, 
then (J3.28P is equivalent to the positive-definiteness of \7 2 &(x). Another case in which (|3.28p is 
satisfied, with a = 1 — p, is when T is a local strict contraction with constant p G ]0, 1[ at the 
fixed point x, namely, for all x in some ball B(x; 5), \\Tx — Tx\\ ^ p\\x — x\\. If T is differentiable 
at x this amounts to ||T"(a?)|| < 1. 



Theorem 3.7 Suppose that Assumptions ] 1 . il and \2.I\ are satisfied, together with (j3.28|) . and let 
FixT = {x}. In addition, let yo £ D and, for every e G ]0,r/[, let (xf)j e j 6e i/ie cyc/e obtained 
as the weak limit of (jl.9p m Proposition ^. 2\ Then (Vi G /) x| — > x as e — > 0. 
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Proof. It suffices to check the assumptions of Theorem 13.41 Set A = Id — T and let x be the 
solution to (13.11). 



• ^Fix,R e (X) — > as e — )• 0: 

Let e G ]0,min{?7, a/(2m)}[, set Q e = Id— meA and 7(e) = 1 — me(a — 2me), and let 
y G DnB(i;i5). Since Ale = and A is 2-Lipschitz, we have 

\\Q £ y — x\\ 2 = \\y — x\\ 2 — 2me{y — x j Ay — Ax) + (me) 2 \\Ay — Ax\\ 2 
^ (1 — 2me(a — 2me))\\y — x\\ 2 
^ 7 (e) 2 ||y-x|| 2 . (3.29) 

On the other hand, setting p = maxjg/ ||TjX — x||/2 and /3 = 3 m — 2m— 1, Lemma 13 . 1 1 gives 

\\R e y-Q e y\\<e 2 /3(\\y-n+p) (3-30) 

which, combined with (|3.29|) . yields 

\\R £ y - x\\ ^ \\R £ y - Q £ y\\ + \\Q £ y - x\\ ^ e 2 (3(\\y ~ *|| + P) + l(e)h - x||. (3.31) 

From this estimate it follows that given 5' G ]0, S], for every e ^ ma.5' /([3(5 r + p) + 2m 2 5'), 
we have R £ (D n -B(x; <5')) cDfl -B(x; 5'). Therefore i? e has a fixed point in B(x; 5') and 
hence <iFix,R e (x) ^ 5'. Since 6' can be arbitrarily small, this proves that dFixi? e (x) —> as 

• x(t) — )• x as t — > +00: 

Let 6*: [0,+oo[ — > [0, +oo[ be defined by 6(t) = \\x(t) — x\\ 2 /2, and let us show that 
lim^+oo 6(t) = 0. We note that this holds whenever the orbit enters the ball B(x;5) at 
some instant to- Indeed, the monotonicity of A implies that 6 is decreasing so that, for 
every t G [t , +00 [, x(t) G D D S(x; 5) and hence (pTTj) and f|3.28[) give 

0'(t) = <x(t) - x I x'(t)> = (x - x(t) I x(t) - Tx(t)) < -a\\x(t) - x\\ 2 = -2a6(t). (3.32) 

Consequently, 0(t) ^ 6>(to) exp(— 2a(t — to)) — > as t — >■ +00. It remains to prove that x(t) 
enters the ball B(x; 5). If this was not the case we would have p = lim^ +00 y/0(t) ^ 5. 
Choose to large enough so that y/Q{to) ^ fx + 8/2 and let x be the solution to the Cauchy 
problem 

( x '(t) = -Ax(t) on [t , +oo[ 
|x(t ) = Xo, 

where xo = x + 8(x(to) — x)/||x(to) — x\\ G D n B(x;5). By monotonicity of A, t i-> 
||x(t) — x(t)|j is decreasing and hence 

(Vt G [t , +00 [) ||x(t) - x|| < ||x(t) - x(t)|| + |[x(t) - x|[ 

< ||x(t ) - x(t )|| + ||x(t) - x|| 
^ (fi-6/2) + \\x(t)-x\\. (3.34) 

Since by the previous argument ||x(t) — x|| — > 0, we reach a contradiction with the fact 
that (Vt G [0,+oo[) ||x(t) - x|| ^ p. 

15 



Altogether, the conclusion follows from Theorem 13.41 □ 

Remark 3.8 If Id— T were globally (rather than just locally as in (|3.28|) ) strongly monotone at 
every point in FixT, we could derive Theorem 13 . 71 directly from Theorem 12 , 81 and Remark |2"T 



Theorem 13.71 can also be applied when the local strong monotonicity or the local contraction 
properties hold up to an affine subspace (see (|3.35p below). This is relevant in the case studied 
in [6] when (Tj)j e / is a family of projection operators onto closed affine subspaces (x{ + £^)j 6 /, 
where (-Ej)jg/ is a family of closed vector subspaces of 7i, and more generally for unbounded 
closed convex cylinders of the form (Bi + JS^gj, where Bi is a nonempty bounded closed convex 
subset of E^~. 

Corollary 3.9 Suppose that Assumptions \1.1\ and \2.1\ are satisfied, that D = %, and that 
(Ti)i € i is a family of projection operators onto nonempty closed convex subsets (Cj)j g / of %. 
In addition, suppose that the set S of minimizers of $ in (|1.3p is a closed affine subspace, say 
S = z + E, where z Gli and E is a closed vector subspace ofH. Let yo G D, set x = PsUo, and, 
for every e G ]0, 77 [, let (xf)j g / be the cycle obtained as the weak limit of (|1.9p in Proposition \2.2\ 
Then the following hold. 

(i) (Vi G /) x\ — ^ x as e ->■ 0. 
(ii) Suppose that 

(yyeS)(3p€ [0,1[)(3<5 £]0,+oo[)(Vx£B(0;5)nE ± ) \\T(x + y) -Ty\\ <p||x||. (3.35) 
Then (Vi € I) x\ — > x as e — > 0. 



Proof. Let i 6 I. Since S = z + E, we have Q + E C C, and the iterates (y|)fceN m P-^P 
move parallel to E 1 - and remain in yo + ^" L - Hence, since {x} = S D (yo + £^)> (i) follows by 



applying Theorem 12.81 in the space yo + -^ j while (ii) follows by applying Theorem 13.71 in this 
same space. D 

We conclude the paper by revisiting De Pierro's conjecture in the affine setting investigated 
in [B] . More precisely, we shall derive an alternative proof of the main result of [6 J from Corol- 
lary 13.91 For this purpose, we need the following notion of regularity. 

Definition 3.10 A finite family (i£j)j 6 j of closed vector subspaces of H with intersection E is 
regular if 

(V(y fc )neN G ^ N ) max^(y fc )^0 =* d E (y k ) -> 0. (3.36) 

Theorem 3.11 Let (-Ej)jgj be a regular family of closed vector subspaces ofH with intersection 
E and for, every i G I, let x j G % and let Pi be the projection operator onto the affine subspace 
Ci = Xi + E{. Let yo G rl and set S = Argmin Yliei dc ■ Then there exists z G % such that 
S = z + E. Moreover, for every e G ]0, 1], the cycle (xf)i^i obtained as the weak limit of (|1.9p 
in Proposition \2. 2\ exists, and (Vi G /) x\ — > PsUo as e — > 0. 
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Proof. We have (Vz € /) Pj : x i— )• xi+Pe^x— Xj). Hence Trc = a+Lx, where a = (1/m) ^iei(^ i— 
Pe^i) and L = (1/m) ^ i6J P^ . According to [6j Theorem 5.4], the subspaces (Ei)i £ r are 
regular if and only if p = ||LoP E x || < 1, which implies that T is a strict contraction on yo + E 1 - ■ 
From this we get simultaneously that T has a fixed point z, that the least-squares solution set 
is of the form S = z + E, and that (J3.35P holds. Hence, the result will follow from Corollary 13.91 
provided that (xf)i^j exists for every e € ]0, 1]. This was proved in [6^ Theorem 5.6] by noting 
that R £ \ yo+E ± is a strict contraction. Indeed, R £ is a composition of affine maps and an inductive 
calculation reveals that it can be written as R £ x = a £ + L £ x, where a £ £ rl and L £ a linear 
operator which is a convex combination of nonexpansive linear maps, one of which is the strict 
contraction L o P E ± . □ 



Remark 3.12 Corollary I3.^(i)| seems to be new even for affine subspaces (Cj)j e /. Also new in 
Corollary I3.£|(ii) | is the fact that strong convergence holds for more general convex sets than just 
translates of regular subspaces. 
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